Pixel array and image processing apparatus for image-capturing

ABSTRACT

An image-capturing apparatus includes a pixel array including pixels. Each of the pixels includes a transducer for generating signal charge according to the intensity of an incident light beam. The image-capturing apparatus further includes an output circuit for outputting a pixel signal outside the pixel array at a frame rate depending on the pixel position in the pixel array, based on the signal charge; and an output-controlling unit for controlling the operation of the output circuit.

RELATED APPLICATION DATA

The present application claims priority to Japanese Application No.P2004-110008 filed Mar. 30, 2004, which application(s) is/areincorporated herein by reference to the extent permitted by law.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to image-capturing apparatuses thatcapture natural images and that detect optical signals indicatingvarious types of information.

2. Description of the Related Art

Currently, image-capturing devices, for example, charge-coupled device(CCD) image sensors and complementary metal-oxide semiconductor (CMOS)image sensors, are available at low prices. Thus, many home electricalappliances and information technology (IT) apparatuses, for example,camcorders, digital still cameras, mobile phones, and personalcomputers, include cameras. Since CMOS image sensors and other generalmetal-oxide semiconductor (MOS) devices can be manufactured on a commonproduction line, an image-sensing unit and other system units such as asignal-processing unit and an analog-to-digital converter (ADC) can bereadily mounted on the same chip.

Moreover, an image sensor, disclosed in Japanese Unexamined PatentApplication Publication No. 2003-169251, not only captures images, butalso carries out other processes by analog and digital calculations.

This image sensor will now be described. FIG. 9 is a block diagramillustrating the structure of the CMOS image sensor. This image sensorcan capture normal images that are referred to as natural images andthree-dimensional range data of objects in images. The image sensorincludes a pixel array 10 that has a two-dimensional array of pixelsdetecting light, a current-to-voltage (I-V) conversion circuit 12 thatconverts current signals detected by the pixel array 10 to voltagesignals, a correlated double sampling (CDS) circuit 14 that filters outnoise in image signals, an analog memory array 16 that holds the pixelsignals detected by the pixel array 10, a current mirror 18 that outputsthe pixel signals detected by the pixel array 10 to the analog memoryarray 16, a comparator-latch unit 20 that calculates the differenceamong values in memory cells in the analog memory array 16 and thatlatches the resulting difference value, a vertical (V) pixel scanner 22,a horizontal (H) pixel scanner 24, a vertical (V) memory scanner 26, anda horizontal (H) memory scanner 28. The V pixel scanner 22 and the Hpixel scanner 24 control scanning of the pixel array 10. The V memoryscanner 26 and the H memory scanner 28 control scanning of the analogmemory array 16.

FIG. 10 is a block diagram illustrating the connection of the circuitsshown in FIG. 9. FIG. 11 is a block diagram illustrating switchingoperation in the pixel array 10 shown in FIG. 10. FIG. 12 is a circuitdiagram of one pixel in the pixel array 10 shown in FIG. 9.

As shown in FIG. 10, the pixel array 10 includes four types of pixels30, i.e., yellow (Ye), cyan (Cy), green (G), and magenta (Mg). Theanalog memory array 16 includes memory units F1 to F4 corresponding tofour respective frames in high-speed frame scanning. Each of the memoryunits F1 to F4 includes memory cells 32. Signals from the pixels 30 areread through vertical signal lines 34 extending through the pixel array10. Each vertical signal line 34 includes a switch S11 at the upperportion and a switch S12 at the lower portion. The switches S11 and S12are turned on and off in response to a read operation of pixel signals.A switch S13 is provided between the analog memory array 16 and thecomparator-latch unit 20 and is turned on and off in response to a readoperation of memory signals.

As shown in FIG. 12, in this image sensor, five MOS transistors areprovided for one pixel. Each pixel includes a photodiode PD serving as aphotoelectric transducer, a floating diffusion part FD, a transfertransistor T11 that transfers signal charge generated at the photodiodePD to the floating diffusion part FD, an amplifying transistor T12 thatoutputs voltage signals or current signals based on the signal chargetransferred to the floating diffusion part FD, a reset transistor T13that resets the floating diffusion part FD to a power source potentialbased on reset signals (RST), a transfer-controlling transistor T14 thatcontrols timing for switching the transferring transistor T11 based oncolumn selection signals (CGm) and charge transfer signals (TX), and aselecting transistor T15 that controls timing for the amplifyingtransistor T12 to output signals based on pixel selection signals (SEL).

When normal image data is read out, signals from the pixels 30 are readout through the vertical signal lines 34 in the upward direction. The Vpixel scanner 22 and the H pixel scanner 24 sequentially scan each rowand each column to read out the signals from the pixels 30. Then, thesignals from the pixels 30 are processed in the I-V conversion circuit12 and the CDS circuit 14 and are amplified to be output outside thechip as analog image signals.

On the other hand, when three-dimensional range data is processed,signals from the pixels 30 are read out through the vertical signallines 34 in the downward direction. In processing three-dimensionalrange data, frame scanning is carried out at a high rate of, forexample, 14 kfps while a slit-shaped infrared light beam is emitted toan object and the reflected light is detected. Then, the differenceamong four consecutive frames is calculated.

As shown in FIG. 11, in a light-detecting section of the image sensor,color filters are provided on the pixels 30. RGBG primary-color filtersor CMYG complementary-color filters are used. In this image sensor,since color filters need to transmit infrared light whenthree-dimensional range data is processed, CMYG complementary-colorfilters having high transmittance of near-infrared light are used. Whenthree-dimensional range data is processed, four pixels corresponding toCMYG are read out as one range operating unit (ROU) to be combined inorder to cancel differences in transmittance of near-infrared light inthe CMYG filters. The analog memory array 16 includes the four memoryunits F1 to F4 for holding signals of four consecutive frames. In eachof the memory units F1 to F4, the memory cells 32 are providedcorresponding to respective ROUs in the pixel array 10. In thisarrangement, the signals from the pixels 30 pass through the currentmirror 18 and are temporarily held in the memory cells 32 for fourconsecutive frames. Then, the comparator-latch unit 20 calculates thedifference between combined signals from two leading frames and combinedsignals from two succeeding frames and latches the resulting differenceas binary data. When the ROUs detect the infrared light beam, thecalculated difference is “1”, and this data is output outside the imagesensor.

In processing three-dimensional range data, the timing of detecting theinfrared light beam can be used for measuring the distance between eachpixel and the corresponding object.

Data communication can be carried out with signals obtained by encodingpatterns (light intensity change) of a blinking light-emitting diode(LED), using the same image sensor as described above.

For example, as shown in FIG. 13, an LED light source (an LED beamcontroller) 2 blinks in the visual field of a camera 1, and ID data isgenerated by encoding patterns of blinking light. As in processingthree-dimensional range data, the image sensor is controlled so as tocalculate the difference among four consecutive frames. Each ROU detectstiming of changes in the LED light, and outputs this data outside theimage sensor. An external device derives the patterns of the blinkingLED from this timing data. Thus, the external device can obtain data onIDs and pixels that detected the blinking LED light, and thus canidentify objects in an image, superimpose the ID data, other datarelated to the ID data, and the objects on a display, and capturemotions of the objects.

The known image sensor described above can capture image data, and candetect a slit-shaped infrared light beam for processingthree-dimensional range data or can detect blinking LED light. However,since the same pixels detect light for these functions using commonsignals lines in the known image sensor, the operation of outputtingimage data and the operation of processing three-dimensional range dataor of detecting blinking LED light cannot be simultaneously carried out.

Thus, in the known image sensor, the operation mode must change betweenan image-capturing mode and an optical-change-detecting mode every frameso that more than one type of data seem to be simultaneously output.

However, in the known image sensor, when image data is processed, imagedata is captured every other frame, and thus the usability of the imagesensor is impaired. For example, in a system that is designed so as touse consecutive frames captured by a regular image sensor, the knownimage sensor may be installed instead of the regular image sensor so asto carry out a three-dimensional range data-processing function and anID data communicating function in addition to an image-capturingfunction. In this case, there is no compatibility of image data betweenthe known image sensor and the regular image sensor. Thus, the systemneeds to be rebuilt so that the system can control image data capturedby the known image sensor.

Moreover, since every other frame is available in detecting blinking LEDlight, when ID data is retrieved from an LED provided in an object thatmoves quickly, the object may not be correctly tracked due to time lag.

SUMMARY OF THE INVENTION

An image-capturing apparatus according to the present invention includesa pixel array including pixels. Each of the pixels includes a transducerfor generating signal charge according to the intensity of an incidentlight beam. The image-capturing apparatus further includes an outputcircuit for outputting a pixel signal outside the pixel array at a framerate depending on the pixel position in the pixel array, based on thesignal charge; and an output-controlling unit for controlling theoperation of the output circuit.

An image-capturing apparatus according to the present invention includesa pixel array including pixels. Each of the pixels includes a transducerfor generating signal charge according to the intensity of an incidentlight beam. The image-capturing apparatus further includes an outputcircuit for outputting a pixel signal outside the pixel array, based onthe signal charge; an output-controlling unit for controlling theoperation of the output circuit; and a signal-processing unit. Thesignal-processing unit includes signal-processing circuits. Apredetermined signal-processing circuit depending on the pixel positionin the pixel array processes the pixel signal.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a block diagram illustrating the connection of circuits in animage sensor according to a first embodiment of the present invention;FIG. 1B illustrates the Bayer pattern;

FIG. 2 is a circuit diagram of pixels in the image sensor shown in FIG.1A;

FIG. 3 is a timing chart illustrating the operation of reading out imagedata in the image sensor shown in FIG. 1A;

FIG. 4 is a timing chart illustrating the operation of processingthree-dimensional range data and ID data in the image sensor shown inFIG. 1A;

FIG. 5 is a block diagram illustrating the connection of circuits in amodification of the image sensor according to the first embodiment shownin FIG. 1A;

FIG. 6 illustrates an arrangement of color filters in a modification ofthe image sensor according to the first embodiment shown in FIG. 1A;

FIG. 7 illustrates an arrangement of color filters in anothermodification of the image sensor according to the first embodiment shownin FIG. 1A;

FIG. 8 illustrates the wiring of pixels in another modification of theimage sensor according to the first embodiment shown in FIG. 1A;

FIG. 9 is a block diagram illustrating the overall structure of a knownimage sensor;

FIG. 10 is a block diagram illustrating the connection of circuits inthe image sensor shown in FIG. 9;

FIG. 11 is a block diagram illustrating an arrangement of color filtersin the image sensor shown in FIG. 9;

FIG. 12 is a circuit diagram of one pixel in the image sensor shown inFIG. 9;

FIG. 13 illustrates a camera system for processing ID data, the camerasystem including the known image sensor; and

FIG. 14 is a schematic view illustrating a camera module according toanother embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

In an image-capturing apparatus according to a first embodiment of thepresent invention, a pixel array in a CMOS image sensor includes pixelsthat capture normal images and pixels that are used for processingthree-dimensional range data and ID data. These two types of pixels areseparately provided. Signals are read out from the two types of pixelsat respective frame rates and are processed in respectivesignal-processing circuits. Thus, capturing of normal images (naturalimages) and processing of three-dimensional range data and ID data canbe simultaneously carried out.

Moreover, the operations described above are carried out in differentsignal-processing circuits at different frame rates, corresponding tocolor components of filters of pixels in one matrix. The pixels in thematrix have respective color filters, other than one pixel that has nocolor filter or has a color filter having no wavelength-selectivity. Inthis arrangement, the operations are carried out in differentsignal-processing circuits at different frame rates, corresponding tothese two types of pixels.

Preferably, these pixels are controlled with respective control lines,and signals from the pixels are read out through respective signalslines.

Moreover, these types of pixels may be provided in different regions inthe pixel array.

In this image-capturing apparatus, for example, first pixels thatcapture natural images and second pixels that detect infrared light maybe separately provided, and different frame rates and signal-processingcircuits may be used for these two types of pixels. Simultaneously, thefirst pixels may capture natural images and the second pixels may detectthe reflected light of probe light in the light-section method, usingdifferent frame rates and signal-processing circuits. Simultaneously,the first pixels may capture natural images and the second pixels maydetect optical signals generated by changing light intensity (blinkinglight), using different frame rates and signal-processing circuits.Moreover, the first pixels and the second pixels may simultaneouslydetect various types of optical signals generated by changing lightintensity, using different frame rates and signal-processing circuits.

In this arrangement, natural images may be retrieved by reading outsignals of columns of pixels in the array in parallel (referred to as acolumn-parallel mode) through a plurality of output signal lines, or byreading out signals of each pixel in the array one by one (referred toas a pixel-by-pixel mode).

FIG. 1A is a block diagram illustrating the connection of circuits in animage sensor according to a first embodiment of the present invention.FIG. 2 is a circuit diagram of pixels in the image sensor shown in FIG.1A.

While image signals are processed for each pixel one by one in the knownimage sensor described with reference to FIGS. 9 to 12, in the firstembodiment, a CDS circuit is provided for each column of pixels andcancels noise of image signals from the pixels to output the imagesignals through horizontal signals lines, as shown in FIG. 1A. The firstembodiment will now be described.

The numbers of columns and rows of the pixel array and the analog memoryarray are the same as those in the known image sensor shown in FIG. 9.That is, one pixel array includes 320×240 pixels, and an analog memoryarray 120 includes four units of memory cells. Each unit includes160×120 memory cells for one frame.

Moreover, while CMYG complementary-color filters having a mosaic patternare used in the known image sensor, RGB primary-color filters are usedin this embodiment.

In general, the Bayer pattern (RGBG) including 2×2 matrices is used inthe primary-color filters, as shown FIG. 1B. Two elements in each 2×2matrix correspond to green. On the contrary, in the first embodiment,one of these two elements corresponds to white (W). The white elementhas no filtering function, and all light components in the entirewavelength range thus pass through the white element. Pixelscorresponding to white elements are used for detecting reflected lightresulting from infrared light that is emitted when three-dimensionalrange data is processed, and are used for detecting blinking LED lightwhen ID data is processed. In this embodiment, first pixelscorresponding to red, green, and blue elements are used for capturingnormal images, and second pixels corresponding to the white elements areused for detecting light intensity changes, as described above. That is,these two types of pixels have distinct functions and simultaneouslyoutput respective data.

The structure of this image sensor will now be described with referenceto FIGS. 1A and 2. The overall structure of this image sensor is thesame as that shown in FIG. 9.

As shown in FIG. 1, RGBW color filters having the Bayer pattern areprovided for pixels 101 in a pixel array 100. Vertical signal lines 102extend in the upward direction, parallel to rows of pixels, to connectto respective CDS circuits 103 through switches S1. The CDS circuits 103connect to horizontal signal lines 104 and an H scanner 105.

On the other hand, the vertical signal lines 102 extend in the downwarddirection to a current mirror 106 through a switch S2. The output of thecurrent mirror 106 connects to memory cells (F1 to F4) 107 for fourframes. The memory cells 107 connect to a comparator 108 and a latchcircuit 109. The output of the latch circuit 109 connects to a detectiondata output line 110 through a switch S5.

As shown in FIG. 2, in this image sensor, four MOS transistors areprovided for each pixel. The following elements are provided for thepixel: a photodiode PD serving as a photoelectric transducer, a floatingdiffusion part FD, a transfer transistor T1 that transfers signal chargegenerated at the photodiode PD to the floating diffusion part FD basedon charge transfer signals (TX), an amplifying transistor T2 thatoutputs voltage signals or current signals based on the signal chargetransferred to the floating diffusion part FD, a reset transistor T3that resets the floating diffusion part FD to a power source potentialbased on reset signals (RST), and a selecting transistor T5 thatcontrols timing for the amplifying transistor T2 to output signals basedon pixel selection signals (SEL).

In general CMOS image sensors, one vertical signal line (COL) isprovided for each column of pixels, and one pixel-selecting line (SEL),one transfer line (TX), and one reset line (RST) are provided for eachrow of the pixels. In the first embodiment, in addition to these lines,pixel-selecting lines (SEL_W0), transfer lines (TX_W0), and reset lines(RST_W0) are exclusively provided for the second pixels. Moreover,vertical signal lines (COL0 to COL3) are exclusively provided forrespective pixels corresponding to RGBW. Signals from columns of thepixels through these vertical signals lines are processed by CDS in therespective CDS circuits 103. Among these processed signals, WB rowsignals and RG row signals are transferred to respective horizontalsignal lines (Hsig_WB and Hsig_RG) through switches.

The operation of this image sensor will now be described.

FIGS. 3 and 4 are timing charts illustrating the operation of this imagesensor. FIG. 3 illustrates the control of the first pixels, i.e., theoperation of outputting normal images. FIG. 4 illustrates the control ofthe second pixels, i.e., the operation of processing three-dimensionalrange data and ID data. In FIGS. 3 and 4, the respective operations arecarried out in the same video frame period ( 1/30 sec). In FIG. 3,though signals transmitted through the vertical signal lines (COL0,COL2, and COL3) are different from each other, these signals are shownby the same line. CLP and SH indicate clamp timing and sample-and-holdtiming, respectively, in the CDS circuits 103.

As shown in FIG. 3, to read out from the first pixels, pixel-selectinglines (SEL0 and SEL1) are selected, and the floating diffusion part FDin each pixel is reset by applying pulses to reset lines (RST0 andRST1). Then, in each pixel, electric charge from the photodiode PD istransferred to the floating diffusion part FD based on charge transfersignals (TX0 and TX1), and signals corresponding to the electric chargeare read out through the vertical signal lines (COL0, COL2, and COL3).As shown in FIG. 1, column by column, the respective CDS circuits 103process these signals to remove noise from the signals, and the Hscanner 105 then reads out the processed signals to the horizontalsignal lines 104. In the first embodiment, the number of rows in a pixelarray is 240, as in the image sensor shown in FIG. 9, and thus, thenumber of rows of RGBW matrices (ROU) is 120. In this arrangement, whenthe read time for one horizontal scanning (H) period (corresponding toone row of ROUs) is 278 μsec, one frame can be read out in 1/30 sec.When signals are read out at a rate higher than 278 μsec, spare time inone video frame period can be used as a blanking period.

FIG. 4 illustrates the read operation of the second pixels. The rate ofread operation of the second pixels is higher than that of the firstpixels: Frames are read out at a rate of 71 μsec per frame in one videoframe period of 1/30 sec in the image sensor. This rate corresponds to14 kfps. Thus, all rows of the second pixels are read out at a rate of71 μsec, and the read time for one H period (corresponding to one row ofROUs) is 140 nsec. The read operation of the second pixels in one Hperiod is the same as that of the first pixels. After the resetoperation through the reset lines (RST_W0), signals are read out to thevertical signals lines (COL1) by the transfer operation through thetransfer lines (TX_W0). As shown in FIG. 1, these read-out signals aretransmitted in the downward direction through the current mirror 106 andthe analog memory array 120 to be subjected to inter-frame differentialcalculation, as in the known image sensor.

As described above, the operation of reading out image signals from thefirst pixels shown in FIG. 3 and the operation of detecting lightintensity changes through the second pixels in processingthree-dimensional range data and ID data shown in FIG. 4 aresimultaneously carried out at the same video frame period at differentframe rates. Thus, two different types of data can be simultaneouslyretrieved.

In the operations described above, signals are read out from the firstpixels only in the upward direction, and signals are read out from thesecond pixels only in the downward direction. In some operation modes,for example, when only image data is captured, the second pixels mayalso capture the image data to read out luminance signals at the sametime when the first pixels capture the image data. Alternatively,current mirrors, analog memory arrays, and comparators may be providedfor the first pixels and signal lines may extend in the downwarddirection from the first pixels to these circuits, or pixels in each ROUmay share the same current mirror, the same analog memory array, and thesame comparator, as in the known image sensor. In this arrangement, whenonly ID data is detected, the first pixels may also detect the ID data.To enable these alternative operations, the vertical signal lines (COL)include the switches S1 at the upper portion and the switches S2 at thelower portion to change the connection.

In the first embodiment, RGB primary-color filters are used. In amodification of the first embodiment, CMYG complementary-color filtersmay be used, as in the known image sensor.

FIG. 5 is a block diagram illustrating the connection of circuits in themodification of the image sensor according to the first embodiment. FIG.5 is different from FIG. 1 only in the arrangement of the color filters.In the image sensor shown in FIG. 5, M of CMYG is replace with W. Othercomponents in FIG. 5 are the same as those in FIG. 1, and thus thedescription of these components is omitted.

Moreover, though image data are read out in a column-parallel mode inthe first embodiment, the method of reading out image data is notlimited to this mode because the operation of outputting image data andthe operation of detecting ID data through the second pixels can beindependently carried out. Thus, image data may be read out in apixel-by-pixel mode as in the known image sensor. Alternatively, imagedata may be read out from pixels within a window of interest (WOI) usinga special method of reading out image data to output the image data.

Furthermore, in the present invention, the W element having no filteringfunction need not be used, but regular RGBG filters in a matrix may beused, as shown in FIG. 6. In this modification of the first embodiment,for example, pixels corresponding to one of two G filters in the filtermatrix are used for detecting ID data. However, since G filters transmitonly green light, an LED that emits green light needs to be used fordisplaying ID data. Thus, the type of LED is limited. Moreover, pixelshaving other color filters than G filters may be used to detect ID data,or pixels having special filters that transmit only infrared light maybe used.

Furthermore, though the vertical signal lines (COL0 to COL3) areprovided for respective pixels corresponding to RGBW in FIG. 2, one(COL3) of the vertical signal lines may not be provided, and a pixelhaving a G filter and a pixel having a B filter may share one verticalsignal line (COL2), as shown in FIG. 7. In this modification of thefirst embodiment, WB rows and RG rows are not read out in parallel, butare alternately read out row by row. Thus, the horizontal signal lines104 shown in FIG. 1 can be consolidated to one horizontal signal linethat outputs WB row image data and RG row image data. However, thenumber of rows that need to be read for one frame period is twice thatin the embodiment described above. Thus, when the frame rate is the sameas that in the embodiment described above, a higher read rate isrequired.

Furthermore, as shown in FIG. 8, the signal lines (SEL, RST, TX, andCOL) may be provided for each pixel of the 2×2 pixel matrix. In thismodification of the first embodiment, any pixel in a pixel matrix may beset up so as to detect ID data. For example, one or more pixels in eachmatrix, or all pixels in matrices in a certain region in a pixel arraymay be set up so as to detect ID data. This configuration can bedynamically changed using the switches.

Furthermore, the present invention is not limited to the image-capturingapparatus, which is formed on a single chip, but is also applicable to acamera module 304 including an imaging unit 301, a signal-processingunit 302, and an optical system 303, as shown in FIG. 14. The imagingunit 301 and the signal-processing unit 302 may be formed on differentchips or the same chip.

1. An image-capturing apparatus comprising: a pixel array comprising aplurality of pixel matrices, each pixel matrix having a plurality ofpixels, each pixel having a respective position in said pixel matrix,each pixel comprising a transducer for generating a respective signalcharge according to an intensity of an incident light beam; an outputcircuit for outputting from each pixel, based on the respective signalcharge, a respective pixel signal outside the pixel array at arespective frame rate, said respective frame rate depending on therespective position of the pixel in the pixel matrix; anoutput-controlling unit for controlling the output circuit; and asignal-processing unit comprising a plurality of signal-processingcircuits, said signal-processing unit configured to receive eachrespective pixel signal, select a predetermined one of saidsignal-processing circuits for processing each pixel signal, saidselection depending on the respective position of each pixel in thepixel matrix; wherein said signal processing unit is configured toprocess pixel signals at a plurality of different respective frame ratessimultaneously during a single frame period.
 2. The image-capturingapparatus according to claim 1 wherein at least one pixel in each pixelmatrix has a color filter, and a wavelength selectivity of said colorfilter corresponds to the respective position of the pixel in the pixelmatrix.
 3. The image-capturing apparatus according to claim 1, whereinat least one pixel in each pixel matrix has a color filter, and awavelength selectivity of said color filter corresponds to therespective position of the pixel in the pixel matrix, and each pixel isclassified into a first type of pixel, said first type of pixel havingat least one of a no color filter and a color filter withoutwavelength-selectivity, and a second type of pixel having a colorfilter, and each respective position in the pixel matrix corresponds toone said first type and said second type.
 4. The image-capturingapparatus according to claim 1, wherein each pixel is controlled througha control line corresponding to the frame rate.
 5. The image-capturingapparatus according to claim 1, wherein the output circuit outputs thepixel signal through a signal line corresponding to the frame rate. 6.The image-capturing apparatus according to claim 1, wherein each pixelis classified into a first type of pixel adapted for capturing naturalimages and a second type of pixel adapted for detecting an infraredlight beam, and each respective position in the pixel matrix correspondsto one of said first type and said second type.
 7. The image-capturingapparatus according to claim 1, wherein each pixel is classified into afirst type of pixel adapted for capturing natural images and a secondtype of pixel adapted for detecting the resulting reflected light beamfrom an emitted probe light beam in a light-section method, a first setof output circuits associated with the first type of pixel and a secondset of output circuits associated with the second type of pixelsimultaneously output pixel signals, and each respective position in thepixel matrix corresponds to one of said first type and said second type.8. The image-capturing apparatus according to claim 1, wherein eachpixel is classified into a first type of pixel adapted for capturingnatural images and a second type of pixel adapted for detecting anoptical signal generated by changing light intensity, a first set ofoutput circuits associated with the first type of pixel and a second setof output circuits associated with the second type of pixelsimultaneously output pixel signals, and each respective position in thepixel matrix corresponds to one of said first type and said second type.9. The image-capturing apparatus according to claim 1, wherein a pixelmatrix detects a plurality of types of optical signals generated bychanging light intensity, and each respective position in the pixelmatrix corresponds to one of said plurality of types.
 10. Theimage-capturing apparatus according to claim 6, wherein the naturalimages are read out from the pixel array in a column-parallel modethrough a plurality of output signal lines.
 11. The image-capturingapparatus according to claim 6, 7, or 8, wherein the natural images areread out from the pixel array in a pixel-by-pixel mode.
 12. An imagingmodule comprising: an image-capturing portion comprising a pixel arraycomprising a plurality of pixel matrices, each pixel matrix having aplurality of pixels, each pixel having a respective position in saidpixel matrix, each pixel comprising a transducer for generating arespective signal charge according to an intensity of an incident lightbeam; an output circuit for outputting from each pixel, based on therespective signal charge, a respective pixel signal outside the pixelarray at a respective frame rate, said respective frame rate dependingon the respective position of the pixel in the pixel matrix; anoutput-controlling portion for controlling the output circuit; and asignal processing portion comprising a plurality of signal-processingcircuits, said signal-processing unit configured to receive eachrespective pixel signal, select a predetermined one of saidsignal-processing circuits for processing each pixel signal, saidselection depending on the respective position of each pixel in thepixel matrix; wherein said signal processing unit is configured toprocess pixel signals at a plurality of different respective frame ratessimultaneously during a single frame period.
 13. The imaging moduleaccording to claim 12 wherein at least one pixel in each pixel matrixhas a color filter, and a wavelength selectivity of said color filtercorresponds to the respective position of the pixel in the pixel matrix.14. The imaging module according to claim 12, wherein at least one pixelin each pixel matrix has a color filter, and a wavelength selectivity ofsaid color filter corresponds to the respective position of the pixel inthe pixel matrix, and each pixel is classified into a first type ofpixel, said first type of pixel having at least one of a no color filterand a color filter without wavelength-selectivity, and a second type ofpixel having a color filter, and each respective position in the pixelmatrix corresponds to one of said first type and said second type. 15.The imaging module according to claim 12, wherein each pixel iscontrolled through a control line corresponding to the frame rate. 16.The imaging module according to claim 12, wherein the output circuitoutputs the pixel signal through a signal line corresponding to theframe rate.
 17. The imaging module according to claim 12, wherein eachpixel is classified into a first type of pixel adapted for capturingnatural images and a second type of pixel adapted for detecting aninfrared light beam, and each respective position in the pixel matrixcorresponds to one of said first type and said second type.
 18. Theimaging module according to claim 12, wherein each pixel is classifiedinto a first type of pixel adapted for capturing natural images and asecond type of pixel adapted for detecting the resulting reflected lightbeam from an emitted probe light beam in a light-section method, a firstset of output circuits associated with the first type of pixel and asecond set of output circuits associated with the second type of pixelsimultaneously output pixel signals, and each respective position in thepixel matrix corresponds to one of said first type and said second type.19. The imaging module according to claim 12, wherein each pixel isclassified into a first type of pixel adapted for capturing naturalimages and a second type of pixel adapted for detecting an opticalsignal generated by changing light intensity, a first set of outputcircuits associated with the first type of pixel and a second set ofoutput circuits associated with the second type of pixel simultaneouslyoutput pixel signals, and each respective position in the pixel matrixcorresponds to one of said first type and said second type.
 20. Theimaging module according to claim 12, wherein a pixel matrix detects aplurality of types of optical signals generated by changing lightintensity, and each respective position in the pixel matrix correspondsto one of said plurality of types.
 21. The imaging module according toclaim 17, wherein the natural images are read out from the pixel arrayin a column-parallel mode through a plurality of output signal lines.22. The imaging module according to claim 17, 18, or 19, wherein thenatural images are read out from the pixel array in a pixel-by-pixelmode.